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Abstract 

Energy efficiency is a key requirement in the design of wireless sensor networks. While most 
theoretical studies only account for the energy requirements of communication, the sensing process, 
which includes measurements and compression, can also consume comparable energy. In this paper, 
the problem of sensing and communicating parallel sources is studied by accounting for the cost of 
both communication and sensing. In the first formulation of the problem, the sensor has a separate 
energy budget for sensing and a rate budget for communication, while, in the second, it has a single 
energy budget for both tasks. Assuming that sources with larger variances have lower sensing costs, 
the optimal allocation of sensing energy and rate that minimizes the overall distortion is derived for 
the first problem. Moreover, structural results on the solution of the second problem are derived under 
the assumption that the sources with larger variances are transmitted on channels with lower noise. 
Closed-form solutions are also obtained for the case where the energy budget is sufficiently large. For 
an arbitrary order on the variances and costs, the optimal solution to the first problem is also obtained 
numerically and compared with several suboptimal strategies. 

Index Terms 

Wireless sensor networks, energy-efficient communication, quantization, rate-distortion theory. 

I. Introduction 

Sensor networks consisting of battery-limited nodes need to be operated in an energy-efficient 
manner in order to attain a satisfactory lifetime. The energy consumption of a sensor device is 
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due mostly to the tasks of sensing and communication. The sensing component consumes energy 
in the process of digitizing the information sources of interest through a cascade of acquisition, 
sampling, quantization and compression, while the communication component spends power to 
operate the transmit circuitry and the power amplifier. It is known that the overall energy spent 
for compression is generally comparable to that used for communication and that a joint design 
of compression and transmission is critical to improve the energy efficiency [OQ 0. We refer to 
the energy cost associated with measurements and compression of sources as "sensing cost". 

A. Contributions 

In this paper, we consider an integrated sensor device consisting of multiple sensor interfaces 
that can simultaneously measure multiple information sources, as illustrated in Fig. Q] Being 
part of the same device, the sensor interfaces share the same overall resource budget. Moreover, 
since the sensor interfaces have distinct hardwares and sensitivities, we assume that the sensing 
costs of different sources are generally different. Finally, for tractability, we model the sensing 
cost of a given source as being constant per source sample. 

With sensing costs present, we aim at optimizing the resource (energy or rate) allocation for 
the integrated sensor of Fig. Q] so as to minimize the overall mean squared error distortion of the 
reconstruction of all the sources at the destination. We consider two types of resource constraints. 
In the first, the sensor has a given energy budget used for sensing and a separate rate constraint for 
communication (separate sensing/communication). In the second, the sensor has an overall energy 
budget which is to be spent for both sensing and communication (joint sensing/communication). 
Moreover, in the joint sensing/communication scenario, the sensed sources are assumed to be 
transmitted over orthogonal additive white Gaussian channels with different noise variances. This 
set-up can model a scenario in which different sensor interfaces of the integrated device are used 
at different times and, to avoid delay and buffer overflow, the measurements are transmitted over 
a time-varying channel to the destination as they are measured. 
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For the separate sensing/communication problem, we obtain a closed-form solution for the 
case where the sources with larger variances have lower sensing costs. This corresponds to a 
situation in which the sensor interfaces with higher sensitivity are used to measure sources with 
lower variances and thus consume more energy in sensing iHJ. When the source variances and the 
sensing costs are arbitrarily ordered, the optimal solution is obtained using numerical methods and 
is compared with several suboptimal strategies. For the joint sensing/communication problem, 
assuming that sources with larger variances not only have lower sensing costs, but also are 
transmitted over channels with lower noise variances, we obtain structural results on the optimal 
solution. Moreover, a closed-form solution is obtained for sufficiently large energy budgets. 

B. Related Work 

The joint design of compression and transmission parameters for energy efficiency has been 
investigated through the proposal of various algorithms, for static scenarios in [0 (61 and for 
dynamic scenarios in (HI. In particular, references and (8]| proposed on-line algorithms 
that are able to choose among a finite number of compression options with different energy 
costs. Using Lyapunov optimization techniques, such algorithms can perform arbitrarily close 
to the minimal power expenditure for a given average distortion with an explicit trade-off in 
average delay. In J9]|, for wireless video sensors, an analytical model that characterizes the 
relationship between power consumption of a video encoder and the rate-distortion performance 
was developed. More recently, the problem of energy allocation over sensing and communication 
has been investigated for energy-harvesting sensors in IfTOll . Finally, the model for the per-sample 
sensing cost in this paper is analogous to the per channel use processing cost used in [fTTIl to 
account for the transmitter processing power consumed by a wireless device. We remark that, 
in |[TTll . when the processing energy cost is not negligible, it is no longer optimal to transmit 
continuously, but, instead, bursty transmission becomes advantageous in terms of the achievable 
rate. 
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The rest of the paper is organized as follows. In Section II, we formulate the problems 
of interest. Then, Section III first derives the analytical optimal solution to the separate sens- 
ing/communication problem when the source variance and the sensing cost are ordered, and then 
addresses the same problem in the case of arbitrary parameters. In Section IV, the structure of 
the optimal solution to the joint sensing/communication problem is analyzed for the ordered 
case. Finally, we make some concluding remarks in Section V. 

II. Problem Formulation 

We consider a system in which a sensor measures Q independent parallel Gaussian sources 
and communicates them to a single destination as shown in Fig. Q] The ith source consists 
of n independent and identically distributed (i.i.d.) samples with variance of, i = 1,...,Q. 
Measuring each sample of the ith source entails a given sensing cost per sample es,i, which 
takes into account the energy spent for acquisition, sampling, quantization and compression. We 
are interested in minimizing the overall average distortion D of the reproduction of the sources at 
the destination. We consider two related problems. In the first (separate sensing/communication), 
we assume that the sensor has two resource budgets, an energy budget for sensing and a rate 
budget for communication. In the second (joint sensing/communication), instead, we consider 
the problem of allocating energy between the tasks of sensing and communications. 

A. Separate Sensing/Communication of Parallel Sources 

For the separate sensing/communication problem, we assume the sensor has an energy budget 
E to be used exclusively for sensing of the Q sources, and a total rate R that can be allocated 
for communication. Both E and R are normalized by n so that E is the energy budget per 
source sample and similarly for R. When E and R are limited, it might not be optimal, or 
possible, to sense all the samples from all the sources. We assume instead that the sensor 
measures a fraction 6s,u with < 6s,i < 1, of samples from the ith source, and then sends 
a compressed version of them with rate Ri (R4 > 0). Given the above, the mean square error 
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(MSE) of the reconstruction for the ith source can be obtained as D { = a 2 f(9s,i, Ri), where 



/(%, Ri) = (1 - 6 s ,i) + 9 S ,2' 2R ^ if 6s, > 0, and f{9 s , h R l ) = 1 if 9 s ,i = O. 



We define the sampling fraction vector and rate allocation vector as 6$ = [9s,i ■■■ 9s,q] t an d 
R = [Ri ... Rq\ t , respectively. The problem of minimizing the total MSE is given by 



subject to the sensing energy constraint Yjf=i 9s,i^s,i < E and the rate constraint J2i=i Ri — R- 

B. Joint Sensing/Communication of Parallel Sources 

For the joint sensing/communication problem, the communication link is modeled as a col- 
lection of Q orthogonal channels. We assume that the compressed version of the sensed samples 
from the ith source (1 < % < Q) are transmitted over the ith channel, which is an independent 
complex Gaussian noise channel with noise variance iVj. Each channel consists of nr channel 
uses, where r is the channel- source bandwidth ratio for each source-channel pair. It is also 
assumed that the sensor has a joint energy constraint B on the sensing and communication 
components. Similar to E and R in Section II-A, the energy B is normalized by n as well. 
The sensor measures a fraction 6$a of the samples of the ith source, and transmits the corre- 
sponding compressed samples with power over the ith channel. Since the compression rate 
for each sensed sample of the ith source is given by (r/9s,i) log 2 (l + Pi/Ni), the MSE of the 
reproduction of the ith source at the destination can be obtained as Di = afh(9 s ,i, Pi), where 



h(0 StU P) = (1 - e s>i ) + 6 s ,i{l + Pi/Ni)- 2 ^ if 9 s ,i > 0, and h(9 s>i , P) = 1 if 9 S;i = 0. 



We define the power allocation vector as P = [Pi ... Pq] t . The problem of minimizing the 
overall MSE is then given by 



Q 




(1) 



Q 




(2) 



subject to the overall energy budget constraint Yj?=i 9s,i^s,i + ^P < B. 
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III. Separate sensing and communication 



This section considers the separate sensing/communication problem described in Section II- 
A. To facilitate the analysis, we divide the Q Gaussian sources into K classes with class k 
(1 < k < K) containing q k sources with the same variance o\. Without loss of generality, 
the variances are in descending order, i.e., of > of > ... > a\. Since each class can contain 
an arbitrary number q k of sources, we have strict inequalities among the variances. It is also 
assumed that sources in class k have the same sensing cost es } k- In the following, we first analyze 
the optimal solution for the case when the sensing costs of K classes are also ordered and then 
discuss the more general case. 

A. The ordered variance/cost case 

In this subsection, we assume that sources with larger variances have lower sensing costs, 

e s,i < ••• < e s,K- Such an order is motivated by @), where measuring a source with lower 
variance requires a more sensitive sensor interface, which in turn consumes more sensing energy. 
Note that, while for the general case, the problem in (OQ) can be shown to be convex, there is 
no closed-form solution, as will be discussed later. Focusing on the ordered case as described 
above allows us to obtain an analytical expression for the optimal solution and gain insights into 
the problem. By the convexity of function D(&s, R), it is easy to see that we can assume the 
same fraction 9 s ,k and rate R k are assigned to each source in the kih. class^.. 

For convenience, we divide the range of the energy E into a sequence of intervals E\ = 
(e ,ex), £ 2 = (ei,e 2 ],..., £ K = (e K -i,e K ), where e = 0, e K = +oo and e m = Yn=i Qi e s,i for 
1 < m < K — 1, and divide the range of rate R into a sequence of intervals 1Z\ = (r ,r!], 
"^•2 = (ri,r 2 },..., U K = (rK-i,r K ), where r = 0, r K = +oo and 



'in fact, fixing all other parameters, function D(8s, P) is Schur-convex with respect to the fractions of samples and the rates 
assigned to the sources in a class. Therefore, an equal fraction and rate allocation is optimal (see, e.g., 1131 ). 




1< I < K- 1. 



(3) 
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Proposition 1: For K > 2, assuming o\ > ... > o 2 K and 651 < ... < es,K, the optimal 
solution for the separate sensing and communication problem in Section II-A is obtained as 
follows. Given E £ S m for some 1 < m < K, 

1) If R G TZi for some integer I with 1 < I < m — 1, then it is optimal to fully sample the 
first I classes of sources, i.e., 6* Sk = 1 for 1 < k < I, and to allocate rates as 

^=^—U+l e (4) 

where 1 < k < I. Moreover, there is no need to sense the remaining K — / classes of 
sources, i.e., 6* S k = and R* k = 0, for / + 1 < k < K. 

2) If instead R > r m _i (or R G [Ji >m T^i), then it is optimal to sample the first m — 1 
classes of sources fully, i.e., 6* Sk = 1 for 1 < k < m — 1, and the mth class for a fraction 
9* Sm = min((_E — e m _i)/(g m e5 )m ), 1), and to allocate rates as 



R 



1 E*. 

where 1 < k < m. Moreover, there is no need to sense the remaining K — m classes of 

sources, i.e., 9* Sk = and R* k = for m + 1 < k < K. 
Proof: The proof is based on solving the KKT conditions but special care must be taken 
since the objective function in (Q]) is not continuously differentiable in the entire feasible set. 
Details of the proof are provided in Appendix A. ■ 

Before we discuss the solution given in Proposition 1, we revisit the classical reverse water- 
filling approach, which solves the separate sensing and communication problem in (QQ) in the 
case of zero sensing costs, i.e., e$± = for all 1 < k < K. The interpretation below will also be 
useful in understanding the solution to the joint sensing and communication problem in Section 
V. With zero sensing costs, it is optimal to sample all of the sources fully, i.e., 6* Sk = 1 for all 
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1 < k < K. Moreover, the solution to (QQ) is obtained by solving the dual problem [fT4ll |[T5l 

min (a 2 k 2- 2Rk + aR k ) , (6) 

R k >0 v ' 

for each class k where a is the Lagrangian multiplier (or "rate price") to be selected such that 
the total rate constraint J2k=i QkRk — R is satisfied. Note that we can write 

a\2-^= \ (-2ln2)al2^dr + 4, (7) 



so that the problem in © can be recast as 

rRk rRk 

min / (a - (21n2)a^2" 2r )rfr = min / w k (r)dr, (8) 
Rk>o Jq Rk>o Jo 

where we have defined w k (r) as w k (r) = a — (2 In 2)a\2~ 2r and neglected the constant term o\. 
The product Wk(r)dr can thus be interpreted as the marginal cost (rate price minus reduction 

in distortion) of adding an additional rate dr when the currently assigned rate is r. For a given 

rate price a, the solution of problem © (and hence ©) for any class k with Wk(0) < is to 

increase the rate progressively until w k (r) becomes zero. The corresponding optimal rate is 



where (■)+ denotes max(-, 0). Note that if the source variance is sufficiently small so that Wfe(0) > 
0, then no rate is assigned to the source at all. To obtain the optimal Lagrange multiplier a in 
©, we invoke the rate constraint X)fe=i QkRk = R- It can be easily seen that, the optimal rate 
R* k in © is positive only for the / classes of sources with the largest variances, where / is such 
that R e TZi and, moreover, R* k can also be expressed as in © (see Appendix A). 

Proposition Q] states that, when the sensing costs are taken into account, the optimal solution in 
the ordered case entails sensing sources with the highest variances and then optimally allocating 
rates among the sensed sources using either the reverse water-filling procedure or a variation of 
it. Specifically, in case 1 of Proposition 1, that is, if E E £ m with 1 < m < K and R e IZi 
with 1 < I < m — 1, the first / classes of sources are fully sensed and compression rates are 
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assigned according to the classic reverse water-filling solution. Note that in this case, even though 
there is enough energy to sample more than / sources, given the rate constraint, the optimal rate 
allocation only assigns positive rate to the first I classes. Instead, in case 2 of Proposition 1, i.e., 
if E G 8 m and R > r m _i, it is optimal to fully sample the first m — 1 classes of sources, while 
the sources in the mth class are sampled only partially using the remaining energy. For the mth 
class, the optimal sampling fraction is equal to 6* Sm = vam{{E — e m _i) / '(<Zm e s,m) , 1)> and the 
optimal rate is obtained, for a fixed rate price a, by solving the dual problem 

mm 9*a 2 m 2 e lm +a R m ). (10) 



,,i S.m m i 

2r 

Therefore, the marginal cost becomes w m (r)dr with w m (r) = a — (21n2)cr^2 9s - m and the 
optimal rate allocation is given by 

Comparing with ©, it is seen that rate assigned to each source in class m is scaled by the 

fraction 6* Sm . Moreover, from ([I]), the distortion attained for each source in class m is given by 

6* Sm D* m + (I — 6* S;m )o 2 m , where D* m = a^" 211 " 1 ' 9 *^ is the normalized distortion for the sampled 

fraction of the source, while 0^(1 — Q*sm) corresponds to the total distortion of the non-sampled 

fraction. By imposing the rate constraint J2k=i IkRk = R, a s done above for the conventional 

reverse water- filling solution, we obtain © (see Appendix A). 

We pictorially illustrate the solution for case 2 of Proposition 1 in Fig. [2l where we assume 

K = 5 and — 1, k — 1, ...,5. In this example, the energy E and the rate R are assumed 

to satisfy e% < E < and R > r 4 . Thus, it is optimal to have source 1 and source 2 both 

fully sampled and have source 3 only partially sampled for a fraction 9* S3 = (E — e 2 )/e5 j3 . 

The first two sources and the sampled fraction of source 3 are all described with the same 

distortion, i.e., D\ = D\ = = a/(2m2), where we recall that L>1 is the average distortion 

only for the sampled fraction of source 3. The rate price a is set such that the sum constraint 

R\ + i?2 + R-3 = -R is satisfied. Since source 4 and source 5 are not sampled at all, they are 
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assigned zero rates and thus the corresponding distortions are equal to their variances. Recall 
that in the zero sensing cost case, all the five sources are fully sampled and since R > r 4 , all of 
them are described with the same distortion, i.e., D\ = D| = ... = D%. Moreover, such distortion 
(and thus the optimal rate price a) would be larger than in the case of nonzero sensing costs 
shown in Fig. |2l although the overall distortion in ([I]) would be smaller. 

B. The General Case 

This subsection discusses the solution to the separate sensing/communication problem when 
the sensing costs eg * are arbitrary. In this case, while the problem in (OQ) is still convex, it appears 
prohibitive to obtain an analytical solution. Therefore, we resort to numerical methods. For non- 
differentiable objective functions, such as (OQ), common convex optimization methods [15], like 
gradient descent and Newton's strategies, either do not apply or fail to converge. To avoid the 
non-differentiability of D(0g, R) at points with 9 Sik = 0, we assume that a fraction at least 5 > 
for each source is sampled, where 5 is a small positive real number. The optimization problem 
remains the same as in (OQ) except that constraint < 6 S k < 1 is replaced with 5 < 6 S k < 1 
for 1 < k < K. With such a modification, function D(0g,R) becomes not only convex but 
also continuously differentiable over the new constraint set. The optimal solution to the modified 
problem, which can approximate that of the original problem in (OQ) well when 5 is made small, 
can be obtained numerically using common convex optimization methods. 

Fig. [3] plots the minimum distortion as a function of the energy budget E when there are 
two classes of Gaussian sources with one source in each class, i.e., K = 2 and q x = q 2 = 1. 
The parameters are chosen asi? = 1, <j\ — 2, erf = 1, eg,i = 3 and eg )2 = 1- For the given 
parameters, unlike the assumptions of Proposition 1, source 1 has both larger variance and a 
higher sensing cost than source 2. For comparison, we consider the following two suboptimal 
schemes: 1) Lower Cost First (LCF): sources are sampled starting from the one with lower cost, 
i.e., source 2, so that source 1 is sampled only when there is additional energy left after source 
2 is fully sampled. The available rate R is then split among the sensed sources using the variant 
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of the reverse water-filling solution discussed in the previous subsection that accounts for the 
fact that sources may be partially sampled (recall CCD); 2) Equal Sampling Fraction (ESF): 
the energy constraint is ignored at first and the total rate R is allocated to the sources using 
the classic reverse water-filling solution. The available energy is then used to sample an equal 
fraction from the sources that have received positive rate by the reverse water-filling procedure. 
Finally, with the sampling fraction of each source known, the rate R is re-distributed among the 
sensed sources using the variant of reverse water-filling discussed in the previous subsection. 

Fig. [3] shows that, when E grows beyond q\€s,i + q2^s,2 = 4, the distortion cannot be further 
reduced since both sources are fully sampled. Moreover, LCF is optimal for small energy budgets 
E but becomes strictly suboptimal when E grows larger than 1.1. In this regime, ESF tends 
to perform better. To gain more insight into this result, the optimal 6* s is plotted in Fig. HI As 
shown in Fig. HI when E is smaller than 0.9, all the energy is dedicated to sensing class 2. This 
implies that for small energy budgets E, sensing cost is the dominant factor in determining how 
energy is allocated for sensing. Instead, for E larger than 1.6, a larger fraction from class 1 is 
sampled than from class 2, which suggests that, as E increases, the variance gradually becomes 
a more influential factor in determining the optimal sampling fractions. This explains why ESF 
can outperform LCF for sufficiently large E. 

IV. Joint Sensing and Communication: The Ordered Variance/Cost/Noise Case 

In Section III-A, we investigated the optimal solution to the separate sensing and communi- 
cation problem in CD when source variances and sensing costs are ordered. In this section, we 
analyze the joint sensing/communication problem in © when the source variances, the sensing 
costs and the channel noise variances are ordered. Similar to Section III-A, we divide the Q 
parallel source-channel pairs into K classes, with class k having q k pairs, where 1 < k < K. 
It is assumed that, in class k, the sources have the same variance a\ and the channels have 
the same noise variance N k . Following Section III-A, we assume the source variances and the 
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sensing costs satisfy o\ > ... > a 2 K and e^i < ... < t s ,K, respectively. It is also assumed that 
the channel noise variances satisfy N\ < ... < Nk- While for the general case, the problem in 
© can be shown to be convex, similar to the problem in (OQ) as discussed in Section III-B, there 
is no closed form solution. However, for the ordered case described above, finding an analytical 
solution in closed form is possible under certain conditions. Similar to Section III-A, it can be 
readily shown that it is optimal to allocate the same sampling fraction 9g,k and the same transmit 
power P k to all source-channel pairs in class k. 

For convenience, we divide the range of B to a sequence of intervals: B\ = (6 ,6i], B 2 = 
(61,62],-, Bk = (b K -i,b K ), where b = 0, b K = +00, and 

b^T^Nj Hr^H "I , l<i<K-l. (12) 

We now first summarize the solution of © in the special case of zero sensing costs, i.e., when 
cs,k = for all 1 < k < K. In this case, we can sample all the sources fully, i.e, we set 6s,k = 1 
for all 1 < k < K, without loss of optimality. 

Lemma 1: For K > 2, assuming a\ > ... > a 2 K , N\ < ... < N K and e 51 = ... = e$ t K = 0, if 
B E B m for some 1 < m < K, then it is optimal to assign positive transmit powers only to the 
first m classes of source-channel pairs as 

Pk = 1 -> 1 < k <m, (13) 

and to assign zero power to the remaining classes, i.e., P£ = 0, for m + 1 < k < K. 

Proof: With 63,1 = ■■■ = 0s,k = 1, the optimization of powers P in © is convex and can 
be easily performed using the standard Lagrangian approach (see also discussion below). ■ 
To interpret the solution in Lemma 1, we observe, similar to Section III, the optimal power 
allocation can be obtained by solving the dual problem 

s( ff K i+ t)" +/jrPi )' <i4) 
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for each class k, where f3 is the Lagrangian multiplier (or "power price") to be selected such 
that Ylk=\ QkTPk = B is satisfied. It can be seen that the solution to this problem is given by 

P* k = (r*^2oW)*k - N k ) + , (15) 

and that the corresponding achieved distortion for each of the m classes that are assigned with 
a positive transmit power is given by 

Dl = 4 (l + ^ = (0 2T+1 {olN?)*&, l<k<m } (16) 

where m is such that B e B m . It is interesting to note that, in general, unlike the reverse 

water-filling solution, all the source-channel pairs that are allocated positive powers (or positive 

rates for reverse water- filling) are not assigned the same distortion level in the joint sensing 

and communication problem considered here. Instead, the distortion level is proportional to 

(cr^A^ r ) 2t + 1 . This shows that only in the special case of 0fcjV| T equal to a constant for all 

1 < k < m, all the source-channel pairs with positive powers have the same distortion. Fig. [5] 

illustrates an example for K = 5 and q k = l, 1 < /c < 5 with B e B s . 

In the case of nonzero sensing costs, it is difficult to obtain an analytical characterization even 

in the ordered case. Below, we first summarize some structural properties of the optimal solution 

and then characterize the solution when the energy budget B is sufficiently large. 

Proposition 2: For K > 2, assuming a\ > ... > a 2 K , < £5,1 < ... < es,K and Ni < ... < N K , 

it is optimal to sense and transmit only the first m source classes, for some m with 1 < m < K 

depending on the energy budget B. Moreover, for the sensed m classes, the sampling fractions 

satisfy < 9* Sm < ... < 9* S1 < 1, with 9* Si = 9* S j (1 < i < j < m) only when both are 1. 

Proof: The structural results on the optimal solution are obtained using the KKT conditions. 

As in the proof of Proposition 1, special care must be taken since the objective function in (0 

is not continuously differentiable in the entire feasible set. See Appendix B for details. ■ 

Proposition 2 suggests that the sources with larger variances are sampled for a fraction 

greater than or equal to that of the sources with smaller variances. However, unlike the separate 
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sensing/communication scenario, the sources with larger variances do not need to be fully 
sampled before the sources with smaller variances are sampled. 

We next characterize the optimal solution for the special case when B is sufficiently large so 
that all sources can be fully sensed. We also compute the minimum energy budget that guarantees 
this. To this end, let us define the set B as B = [6, +00), where b is the solution to the equation 



es,K \ V N, 



>K 



1 -! 2- In ( 1 + — 
1 Ni 



K 



with 



A 



(17) 



(18) 



Proposition 3: For K > 2, assuming o\ > ... > a 2 K , < £51 < ... < es,K an d Ni < ... < N K , 
if B e B, it is optimal to fully sample all the K classes of sources, i.e., to set 8* Sk = 1 for all 
1 < k < K and to select transmit powers P* as 

P* = ^ J -, 1 < k < K. (19) 



r^ K a ("IT 



Proof: The proof is based on that of Proposition 2 and is provided in Appendix C. ■ 
Proposition [3] states that, if the energy budget is larger than the threshold b, then it is optimal 
to fully sample all the sources and to allocate power as for the case with no sensing costs (see 
(TT3T) ) but with energy budget discounted by the energy needed for sensing (i.e., with energy B — 
Ylfj=i Qj e s,j)- It is interesting to note that the threshold b is strictly larger than &k-i + X)j=i qj£s,j- 
We recall that b K _i is the energy threshold above which it is optimal to assign positive powers 
to all K classes of source-channel pairs in the zero sensing cost case, while Yl!j=\ Qj e s,j is the 
total sensing energy needed to sense all the sources. 

Fig. [6] shows the optimal sampling fractions for the joint sensing/communication problem as 
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a function of energy budget B when parameters are chosen as q 1 = q 2 = 1, a\ = 1.25, erf = 1, 
— e s,2 = 1 and Ni = N 2 = 4. The results are obtained via numerical methods [|T4l . It 
can be seen from Fig. [6l for any £?, #* is greater than or equal to 9 2 , which is consistent with 
the optimal structure derived in Proposition [2l Moreover, when 2 < B < 3, both sources are 
partially sampled, which is not encountered in the optimal solution of the separate sensing and 
communication problem of Section III. As B grows beyond 6, both classes are fully sampled. 
This threshold corresponds to threshold b in (fTTT ) with K = 2 and is strictly larger than bi + 
<?i e s.i + Q2^s,2 = 2.3. It can be observed from Fig. [6] that, if 2.3 < B < 6, the optimal solution 
entails partial sampling of at least source 2 which has the lower variance. In this case, fully 
sampling both sources is strictly suboptimal. 

V. Conclusions 

In this paper, we studied an energy-constrained integrated sensor system that has a constant 
sensing energy cost per source sample and we investigated the impact of the sensing energy 
cost on the end-to-end distortion of parallel Gaussian sources. We formulated a distortion 
minimization problem with either separate constraints on the sensing energy budget and on the 
communication rates, or a joint constraint on the energy budget for both sensing and transmission. 
For both problems, we studied the special case in which sources with larger variances have lower 
sensing costs. We showed that, for the separate sensing/communication problem, the optimal 
strategy is to sense the sources starting from the one with the largest variance and to allocate the 
communication rate using reverse water-filling, or a variant of it, on the sensed sources. Moreover, 
for the joint sensing/communication problem, it is generally optimal to sense, possibly partially, 
only a subset of the sources with the largest variances and to allocate the transmit powers among 
their respective channels. When the source variances and the sensing costs are arbitrarily ordered, 
the optimal solution is obtained numerically for the first problem and compared with several 
suboptimal strategies. Future work includes extension of the analysis presented here to the case 
of an energy neutral sensor system with energy-harvesting capabilities |fi~6l . It is also of practical 
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interest to consider more accurate models for the sensing energy cost. 

Appendix A 
Proof of Proposition 1 

A. Overview of the Proof 

We first note that the objective function D(dg, R) is convex since it is the weighted sum 

of convex functions f(9s,k,Rk)- Function f(9s,k,Rk) can be easily seen to be convex since it 
is the linear combination of an affine function and of the perspective function of 2~ 2Rk [15]^. 
However, function D(Os, R) is not differentiable at points with 9s, k = for any k. 

It is easily seen that the constraint set of function D(6 S , R) is a polytope. Since the function 
is continuous over the polytope, by Weierstrass's Theorem Ifl4l . a global minimum exists. Due to 
convexity, locally optimal points of function D(0 S , R) are also globally optimal. Moreover, the 
constraints are affine, and thus by Slater's condition, strong duality holds and optimal Lagrange 
multipliers exist for the dual problem. Note that, this is true irrespective of the lack of differen- 
tiability. To find locally optimal points, we can involve the KKT conditions as being necessary 
and sufficient wherever the function is continuously differentiable. In particular, any point in the 
constraint set with 6$ > (i.e., 9s,k > for all k) that satisfies the KKT conditions is optimal. 
In Appendix A-B, we show that, if (E, R) e A x , where A x = {(E,R)\E > e K _ x ,R > r K _{\, 
then such a locally minimum point exists and is given by 9* Sk = 1 for 1 < k < K — 1, 
9* SK = min((E - e K _i)/(q K e s ,K), 1) and R* k as in © with m replaced by K for 1 < k < K. It 
is also shown that, for E and R such that E > e/ and R E (r^i, ri\ for some 1 < I < K— 1, there 
exists points with 6s > that satisfies the KKT conditions. However, in this case, the optimal 
R* is given by R* k as in © for 1 < k < I, and R* k = for / + 1 < k < K, therefore, as long 
as 9* S k = 1 for all 1 < k < I and Ef=m QkO s , k < E - e h the choice of 9* S k for I + 1 < k < K 
is arbitrary. For all other choices of (E, R), no point with 6 S > satisfies the KKT conditions 

2 Convexity in the set 8s,k > follows by continuity from the properties of perspective functions. 
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and thus the optimal solution must have some sampling fractions 0* Sk equal to zero. It is not 
hard to see that, due to the order imposed on the variances and sensing costs, in such a case, 
0* s K must be set to zero. Hence, we can conclude that if (E, R) ^ A\, then it is optimal to set 
6* s K = and R* K = 0. The problem then reduces to the one studied above but with only the 
first K — 1 classes of sources. Therefore, an optimal solution of this problem can be obtained by 
again solving the KKT conditions. By using the same reasoning as above, an optimal solution 
is found only if (E, R) belongs to A 2 = {(£, R)\(E, R) g A U E > e K _ 2 , and R > r K _ 2 } or 
E > e\ and R G (rj_i,rj] for some 1 < I < K — 2. If such conditions are not met, then the 
optimal solution must have 6* s K = 9* K _ X = and R* K = R* K _i = 0. The procedure is repeated 
until a solution is found by solving the KKT conditions. Note that, as mentioned, the optimal 
solution must exist by Weierstrass's theorem. 



B. Solving the KKT Conditions 

To find whether an optimal point exists with Os > 0, we define the Lagrangian function 

K K 

Lx(O s , R, fi, v, a,(3) = J2 4lkf(ds,k, Rk) + ~ 1) (20) 

fc=i fc=i 

K / K \ / K \ 

+ M-Rk) + a I J2 QkRk -Rj d sm^s,k -E\, (21) 

k=l \k=l / \k=l / 

and invoke the KKT conditions which are both necessary and sufficient [fT4ll . It follows that 
(6* s , R*) is an optimal point with 6 S > 0, if and only if there exists Lagrange multiplier vectors 
H* > 0, u* > and multipliers a* > 0, 0* > such that 

^ = o\ qk {-I + 2^5 + ) + A + P*ms,k = 0, k = 1, 2, K, (22a) 

2R k 

-(2ln2)a 2 k q k 2~^ -v* k + a *q k = 0, k = 1, 2, K, (22b) 



9Lx ,., n , 



dR k 
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ti(0*s,k - 1) = 0, "k(-K) = °> k = l,...,K, 



(23a) 



and /?* [Y^^Qkest-E] = 



a* J^g^-tf =0, 




fc=i 



(23b) 



(23c) 



\fc=i / 

are satisfied. It can be seen that we can find a solution only in the following cases. 

. Case 1: R* satisfies R% > for 1 < k < K while 6* s satisfies 9* Sk = 1 for 1 < k < 
K — 1 and < 9* SK < 1. It is easily seen that for these to hold, we need E > ex-i- 
By (l23al) . < 9* SK < 1 implies \i* K = and thus it follows from (l2~2~al) that /?* > 0. 
Then, by (EB, Ef=i fc 9fces,fc = -E holds. Therefore, for E < J2i=i1i e s,i, we have 
9* s K = (E — ck-i) / (qk^s,k)- From (|23al) , u k — holds for any fc. Also, it follows from 
(I22bl) that a* > and R* k = {9* s>k /2) log 2 ((2 ln2)a|/a*) for 1< k < K. By (T23bl) . a* > 
implies Y^=iQkR* k = R- Thus, we obtain a* = (21n2)2- 2(ii -5Ef =1 %%iog2^)/Ejli?^s >J . 

and R* as in © with m replaced by if . It is easily seen that in order to have R* K > we 
need R > Tk-i- Hence, there exists a valid solution in this case if and only if e#_i < E < 

Yh=i <li e s,i and R > r K -i- 
. Case 2: For some 1 < / < K, R* satisfies R* h > for 1 < k < I and R* k = for 
Z+l < k < K, while 0* s satisfies = 1 for 1 < k < I and < 9* Sk < 1 for l+l < k < K. 
For these conditions to hold, E needs to satisfy E > ei if 1 < / < K — 1 or E > Ylf=x Qi e s,i 
ifl = K. Similar to Case 1, we obtain a* = (21n2)2" 2(i? "^^=i* log2 ^ )/(E ^=i^ ) and R* k 
as in © for 1 < k < I. If I < K - 1, > implies R < r h If I > 2, i?; > implies 
R > ri-i. Hence, there exists a valid solution if and only if E > ei and R £ (rj_i,n] for 
1 < K if - 1 or E > qie s ,i and i? > r^-i- 
We observe from the above analysis that only when (E,R) belongs to A\ = {(E,R)\E > 
6k-i,R > tk-i}, there exists a unique optimal solution to the KKT conditions with 6$ > 0, 
which is given by 9* Sk — 1 for 1 < k < K — 1, 9* SK = min((E - e K -i) / {qK^s,x), 1) and R* 
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as in ([5]) with m replaced by K. For E and R such that E > e; and i? G (r/_i,r/] for some 
1 < I < K — 1, there also exists points with #s > that satisfy the KKT conditions and at 
these points the optimal rate allocation R* is given by R* k as in © for 1 < k < I, and R* k = 
for I + 1 < k < K. Following the discussion in Appendix A-A, this concludes the proof. 

Appendix B 
Proof of Proposition [2] 

A. Overview of the Proof 

Similar to function D(0g,R) in Appendix A, it can be shown that function D(0s,P) is 

convex but not differentiable at points with 9s,k = for any k. Moreover, to obtain optimal 
points, we can invoke the KKT conditions as being necessary and sufficient wherever function 
D(Os, P) is continuously differentiable. Therefore, as in Appendix A, any point in the constraint 
set with 0s > that satisfies the KKT conditions is optimal. It is shown in Appendix B-B that, 
if a minimum point with s > exists, it has the structure that < 9 S K < ... < 9* s 1 < 1 
and P k > for 1 < k < K, with 9* S i = 9* S j (1 < % < j < K) only when both are equal 
to 1. Instead, if no point with S > satisfies the KKT conditions, similar to Appendix A, 
we must have 9* s K = and accordingly P£ = 0. The problem is then effectively reduced to 
the one studied above but with only the first K — 1 classes of source-channel pairs . Using the 
same reasoning as above, if a minimum point with 9* Sk > for all 1 < k < K — 1 exists, it 
must satisfy < 9^^^ < ... < 9* S1 < 1 and P£ > for 1 < k < K — 1; otherwise, we have 
@s K-i = @s k = an d Pjk-i = Pr = 0- By repeating this procedure, we can find the structure 
of any possible optimal solution as stated in Proposition [21 

B. Solving the KKT Conditions 

Similar to Appendix A-B, we can define a Lagrangian function L 2 (9s, P, A*, 0), with j3 

being the Lagrangian multiplier corresponding to the total energy constraint. From the KKT 
conditions, it follows that (0* s , P*) is an optimal point with 0s > if and only if there exists 
Lagrange multiplier vectors fi* > 0, v* > and multiplier (3* > such that 
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de s>k 



dP k 



dL 2 



dL 2 




-jf-J -* + rr» = 0, k = l,2,... 

»l(e* Stk -i) = o, v* k (-p* k ) = o, k = i,...,K, 



+ H* k + (3*q k e s ,k = 0, (24a) 



K, 



(24b) 



(25a) 



and 0* (J2^(0* Sik e s , k + P:)-B) =0 




k=l 



(25b) 



are satisfied. Given the joint energy constraint, if any optimal point with 6 S > exists, it is 
easily seen that it must satisfy P k > for 1 < k < K. 

We now show that any (6s, P), with < 9s,i < Osj < 1 for some i, j satisfying 1 < 
i < j < K, can be ruled out as an optimal solution. In this case, < 8s,i < Os,j < 1 yields 
Hi = ix j = 0. Moreover, from (12410) and crf/e s ,i > <?]/es,j, it follows that (1 + Pi/Ni) 2T/9s ^ < 
(1 + Pj/Nj) 2 ^ 6 ^, or ln(l + Pi/Ni)/ \n(l + Pj/N 5 ) < 9 s/ J9 Sd . Also, by (l23al P { > and 
Pj > imply u { = Vj = 0. From (l24bl) and a?/^ > a]/Nj, it follows that (l + Pi/Ni) 2 ^ 63 -^ 1 > 
(l + P,yiV,) 2T/ ^ +1 ,or ln(l+P,/iV i )/ln(l+P i /iV i ) > (l+2r/^)/(l+2r/%). If % < 
then (1 + 2r/6s,j)/(l + 2r/9s,i) > 9s,i/9sj- Hence, we have a contradiction. Similarly, the case 
of (&s, P) with < 9 s ,i < 1, ^5,j = 1 for some i, j satisfying 1 < i < j < K, can also be ruled 
out. Hence, any optimal point with 6s > has the following structure: P* satisfies P£ > for 
all 1 < k < K, while 6* s satisfies < 9* SK < ...9* S2 < 9* S I < 1 with 9* Si = 9* S j for some i ^ j 
only when both are 1. Following the discussion in Appendix B-A, this concludes the proof. 



Using the KKT conditions in (|24l) -(l25l). we can derive a closed-form solution for the special 
case when the optimal solution satisfies 9* Sk = l for all 1 < k < K. By Proposition [2l it follows 
that in any such solution, P fc * > for 1 < k < K. By (I25al) . v% — holds for any k. It follows 
from (I24bl) that 0* > and P fe * = /3-^rr(2a2iV fc 2T )^i - A^ fc for 1 < k < K. Also, d25bl) yields 
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Efc=i <?fc(es,fc + rP£) = B - Therefore, we get 



\ B -J2f=iQk(es,k-rN k ) 



) 



2r+l 



(26) 



and P£ as in (TT9b for 1 < k < K. Note that fx* k > needs to hold for any k. With parameters 
ordered, it can be seen that for these conditions to hold, it is sufficient to have [i* K > 0, i.e., 



Hence, this solution is valid if and only if B > b where b is as defined in Section IV and is the 
value of B when (T27l) is met with equality. This concludes the proof. 
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Integrated Sensor 

Fig. 1. Illustration of an integrated sensor device with multiple sensor interfaces sharing the same resource budget. 
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5 Index of source 



Fig. 2. Illustration of the optimal solution for case 2 of Proposition 1, where K — 5, qt — 1 for k = 1, 5 and E and R 
are chosen to satisfy 62 < E < e$ and R > n. 
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Source 
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of 



d: 




Index of Source 



Fig. 5. Illustration of the optimal solution in Lemma 1 when K = 5, qk = 1, k = 1, 5, and _B E £>3. For the first three 
sources, the optimal distortion level D%. is proportional to (alN% T ) 2t+1 , for 1 < fc < 3. The last two sources are assigned a 
zero rate and thus their distortion levels are equal to the source variances. 
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Energy Budget B 



Fig. 6. Optimal sampling fractions 0s for qi = q2 = 1, o\ — 1.25, o\ = 1, es,i = es,2 = 1 and Ni = 7V2 = 4. 
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